Papers with LLM-based conversational agents
Towards Automated Error Discovery: A Study in Conversational AI (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows that LLMs require information about the nature of an error or hints about its occurrence for accurate detection. |
| Approach: | They propose an encoder-based approach to detect and define errors in conversational AI. |
| Outcome: | The proposed framework outperforms baselines across multiple error-annotated dialogue datasets and shows strong generalization to unknown intent detection. |
SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation (2026.eacl-demo)
Copied to clipboard
Sergio Burdisso, Séverin Baroudi, Yanis Labrak, David Grünert, Pawel Cyrta, Yiyang Chen, Srikanth Madikeri, Esaú Villatoro-tello, Ricard Marxer, Petr Motlicek
| Challenge: | SDialog is an open-source Python toolkit for end-to-end development, simulation, evaluation and analysis of LLM-based conversational agents. |
| Approach: | They present an open-source Python toolkit for end-to-end development, simulation, evaluation and analysis of LLM-based conversational agents. |
| Outcome: | SDialog enables more controlled, transparent, and systematic research on conversational systems. |
Beyond Words: Integrating Theory of Mind into Conversational Agents for Human-Like Belief, Desire, and Intention Alignment (2025.findings-acl)
Copied to clipboard
| Challenge: | Empirical evaluations of LLaMA-3 models demonstrate that ToM-informed alignment improves response quality, achieving win rates of 63% and 67%, respectively. |
| Approach: | They investigate whether open-source LLaMA models can represent and retain ToM-related constructs and whether they can be used to generate more aligned responses. |
| Outcome: | The proposed models can represent and retain ToM-related constructs and improve response quality. |
AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation (2025.findings-acl)
Copied to clipboard
Ming Wang, Peidong Wang, Lin Wu, Xiaocui Yang, Daling Wang, Shi Feng, Yuxin Chen, Bixuan Wang, Yifei Zhang
| Challenge: | Existing models of seeker simulations are limited by the cost and ethical concerns of involving real seekers in mental health research. |
| Approach: | They propose an emotional and cognitive dynamic agent system equipped with tertiary memory to enable dynamic control of the simulator's configurations. |
| Outcome: | The proposed system achieves more realistic seeker simulation compared to baselines. |